Rate-Distortion-based Combined Motion Estimation and Segmentation

This paper uniies the problems of variable block size motion estimation (VBSME) and region-based segmen-tation using a quadtree approach. The quadtree's nodes are each labeled providing region-based segmentation, and the same quadtree is also used for block motion estimation. The Lagrange multiplier method and a tree-pruning technique are used to nd the optimal tree which achieves the joint optimization of VBSME and the seg-mentation representation in the rate distortion sense. Perceptually-based bit allocation is achieved with a region-weighted distortion measure. A video coder employing this technique results 0.1-0.7 dB gains over MPEG-2. Moreover, the proposed coder combined with perceptual weighting achieves uniform visual quality across each frame. The proposed approach can be easily adapted to MPEG-4 based coders.